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^ . Abstract 

o 

I Consider two random walks on Z. The transition probabilities of each walk is 

dependent on trajectory of the other walker i.e. a drift p > 1/2 is obtained in a 
position the other walker visited twice or more. This simple model has a speed 
which is, according to simulations, not monotone in p, without apparent "trap" 

■ behaviour. In this paper we prove the process has positive speed for 1/2 < p < 1, 
and present a deterministic algorithm to approximate the speed and show the non- 

^ . monotonicity. 

-g- 1 Introduction 

Excited random walk or "cookie motion" is a well known model in probability 
theory introduced by Benjamini and Wilson in |BW03j . A random walk on Z*^ is 
excited if the first time it visits a vertex there is a bias in one direction, but on 
J> I subsequent visits to that vertex the walker picks a neighbor uniformly at random. 

■ Benjamini and Wilson proved that excited random walk on Z*^ is transient iff d > 1. 
\^ ■ Benjamini and wilson also proved that for d > 4 (later proved by Gadi Kozma for 

I d < 2 |Koz05] ) that excited random walk has linear speed. That is 

d 



- 

X 



. X(n)i 
liminf ^ ^ > 

n^oo n 



where X{n) is the position of the walk at time n and X{n)i is the projection of 
X{n) to the first coordinate (the direction of the bias). Kozma proved in |Koz03j 



^ ■ that in three dimensions excited random walk has positive speed. That is 

X(n) 
lim — ^ > 0. 

n— >oo Tl 

Martin P. W. Zerner defined in |Zer04j a generalization of the Benjamini- Wilson 
model. Zerner defines a cookie environment as an element 



oj = ((w(z,i)).>o).ez G = ([1/2, 1]^)' 
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where u}{z,i) is the probabiHty for the random walk to jump from z to z + 1 if it 
is currently visiting z for the i-th time. In that paper Zerner proved monotonicity 
of hitting times with respect to the environment (Lemma 15 of |Zer04j ). i.e let 
u}i,uj2 G ^+ with uji < UJ2 and -co < x < y < z < oo, y S x, z G Z U {00} and 
t e NU{oo}. Then 

Py,uj^ [n < T.^ A t] < Py,^2 [T, < T^. A t]. 

Using the above lemma, Zerner proved monotonicity of speed with respect to the 
environment (Theorem 17 of |Zer04j ) . i.e let P be a stationary and ergodic proba- 
bility measure on such that P(a;i < a;2) = 1 then vi < V2, where Vi is the Po,aJi 
a.s limit of i G {1,2}, under the assumption that both limits exist and are a.s 
constants. 

Recently Itai Benjamini proposed a new model. Consider two random walks 
{Xn,Yn) on Z each eating its own favorite kind of cookie. The transition probabili- 
ties of each walk is dependent on the number of cookies the other walker has eaten. 
The cookie environment is an element 
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satisfying 



Define ^„ 
is defined by 



'^i(^)^ 

V^2(z), 
{Xo<m<n,Yo<m<n) 



2 ? 2 ' ^' ^' ^' ' 
2 ' 2 ' ' 



(1.1) 



(1.2) 



the mutually excited random walk (MERW) 



F[Xn+l = Xn + 1|^ 
P[Xn+l 



Xn - l\^n] 
Yn + l\^n] 
Yn, 1 'j:^ T). 



UJl{Xn, #{m <n:Yra = Xn}) 
1 - UJi{Xn, #{m <n:Ym = Xn}) 

C02{Yn,#{m<n:Xn, = Yn}) 

1 - uj2{Yn, #{m < n : X„ = Yn}) 



(1.3) 



The main interest in Benjamini's model arises from the fact that simulation 
results indicate that the limiting speed is a non monotone function of the drift 
parameter p (see Figure 11.11 created by computer simulation). This stands in 
contrast to Zerner's result that for self excited random walk the limiting speed is 
monotone. 

In this paper, we prove that a MERW is transient and has positive speed for all 
p G (1/2, 1] (Theorem 13. ISp . Using approximation by a family of Markov processes 
we prove that v{p) is continuous in [1/2, 1) (Lemma 14. 3p . where v{p) is the speed of 
a MERW with drift p. We also present a scheme for a computer assisted proof of 
the non monotonicity. At present time we do not have a conceptual proof for the 
non monotonicity in this model. 



2 RWRE preliminaries 
2.1 RWRE facts 

In this section we give a short introduction, based on |Zei06j . to one dimensional 
random walk in random environment (RWRE) and state its use in this paper. Let 
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Figure 1.1: Simulation results for the speed of MERW. 



^ be the interval [0, 1] and set Q, = We endow Q, with the product fi-algebra 
and a product measure P (i.i.d RWRE). For any environment to £ Q we define a Z 
valued Markov process {^n}n>o endowed with the quenched 

FzA^o = z) = l 

Fz,U^n+l=Cn + MCo,Cl,---,Cn) =^{Cn) P^.^-a.S (2.1) 
Fz,UCn+l =U - MCo,Cl, • • • ,Cn) = 1 - P2,^-a.S. 

The annealed measure is defined on x by Pz{') = ^[Pz,lu{')]- Define px = 
^ uj(x)^ ' assume E(Iog/Oo) is well defined and 1 > oj{x) > 0. 

The following theorem is a special case of Theorem 2.1.9 of |Zei06j . 



Theorem 2.1. //E[po] < 1 then 



E 













Lemma 2.2. Let ^„ be an i.i.d RWRE starting at 0, then the annealed probability 
of backtracking k steps before reaching +1 is smaller than 2(Epq)^. 

Proof. Let Ti = inf{n|^„ = i} and Vu)iz) = Pz,u}{T-k < ''"i)- We can obtain a 
recursion relation |Zei06j 



Vu){z) = UJzVujiz + 1) + (1 - UJz)Vujiz - 1) 

vM) = 0, vU-k) = 1. 



(2.2) 



Iterating equation (j2.2p . yields 

= pop^i ■ ■ ■ p_^k-i)[vuj{-{k - 1)) - v^{-k)] 



(2.3) 



Taking expectation over the environments and using independence we obtain 
v{0) = Bv^iO) = Po(r„fc < n) < 2(Epo)^ 

□ 

Corollary 2.3. Let ^„ be an i.i.d RWRE starting at 0. Then 

E [(1 - P.,.(r_, < n))"] > (l - 2(Epo)')" . (2.4) 

Proof. The inequahty is Jensen's inequahty. □ 

Another useful result in RWRE we will use in this paper is that large deviation 
probabilities for environments with only positive and zero drifts decay like . 
The following theorem, which is Theorem 1.2 of |DPZ96j . states this precisely. 



Theorem 2.4. Suppose that E[/3] < 1, but pmax = 1 and P{uJo = ^) > 0- Then for 
any open G C (0, Va) which is separated from 

-oo < liminf n~^/^logP(n^^X„ G G) < limsupn"^/^ logP(n~^X„ G G) < 0. 



2.2 Applications of RWRE for MERW 

Definition 2.1. We define the right front and the left front of the MERW by 

Mx{n) = max{Xm : 1 < m < n} 
My(?i) = ma.x{Ym : 1 < m < n} 

Rn = ma.x{Mx{n),MY{n)} 

L„ = min{Mx(n),My(n)} 

The particle associated to the right front at time n is if Rn = Mx (n) and it is 
Yn if Rn = Myin). If Rn = Mx{n) = Myin) we choose to be the right front 
arbitrarily. 

The main use of RWRE in our paper is captured in the next lemma. The next 
lemma shows that the number of doubly eaten cookies the particle associated to 
the left front sees, stochastically dominates an i.i.d random environment. 

Definition 2.2. Let : Z — )■ {1/2, p} be defined as follows: for every x G Z there 
exists the first time n such that L„ = x + 1. If at time n both walks ate the cookies 
in position x, ^[x) = p, else ^(x) = 1/2. We call ^ the intersection environment. 

Definition 2.3. Let u and co' be to environment defined on the same space. We 
say uj dominates u' is there is a coupling Q on the product space such that Q{oj > 
(jo') = 1, where u > oj' stands for point wise domination. 



Lemma 2.5. The intersection environment ^ dominates an i.i.d random environ- 
ment with 

2 

p w.p (1 — p)^ 



uj{x) 



i w.p 1 - (1 -p)^ 
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Proof. Every time a walker turns left to some positive position, we know it ate 
all the cookies in that position. Our goal is to build a random environment that 
controls the movement of both walkers. We do it by building an environment that 
is an intersection of some of the doubly eaten cookie sites of both the walkers. We 
build the environment in the following manner: Consider some time n such that 
Ln > X + 1. The probability both of the walkers turn left on their first visit to 
X + 1 is greater than (1 —p)^- Define a coupling, Ux{x),Uy{x) ~ U{0,1) i.i.d. 
On the first visit to x + 1, X turns left if Ux{x) > 0Ji{x + 1) and Y turns left if 
Uy{x) > 0J2{x + 1). oj{x) = p \i Ux{x) < (1 — p) and Uy{x) < {1 — p) otherwise 
uj{x) = ^. By this coupling we know that if oj{x) = p, both of the walks turned left 
at their first visit to x + 1. □ 



For the random environment described in lemma [231 let us make some calcula- 
tions we will use in later sections. 



E[/)J = E 

E 



1 — uj{x) 



1 

Wo 



oo{x) 
2p{2 -p) + 



3 



P 

{l-pf 



+ p(2-p) <l 



(2.6) 



p 

By theorem l2.1l the speed of the RWRE induced by the MERW is 
lini ^ = ^ - ^[/^o] = (i-p)2(2p-i) 

n^oo n E 1"^] 2p2(2 -p) + (1 -p)2 ■ (2.7) 

Remark 1. At this point it is not yet clear that the MERW even has a positive 
speed. This we prove in the next section. 

3 Positive speed 

3.1 Transience of the walks 

In this section we use notations and ideas introduced by Martin P.W. Zerner in 
|Zern4j . 

Definition 3.1. Denote by TRSS, the event {\/z G Z,3nV?n > n,(^m ^ z}. A 
process {^n}^=i is transient if P{TRS^) = 1. 

Definition 3.2. Let 2; € Z,z > 0, define the events 

RECX{z) = {Xn = z i.o} 
RECYiz) = {Yn = z i.o}. 



(3.1) 



For a given z, if RECX{z) occurs, we say that {Xn}"^^-^ is z-recurrent. Same for 

Proposition 3.1. The MERW is transient for p = 1. 

We prove this proposition by a sequence of lemmas. 
Lemma 3.2. For every z' > z, P{RECX{z')\RECX{z)) = 1. 
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Proof. Every time {^n} reaches z it has some positive probabihty to reach z' > z. 
Thus by standard arguments {Xn} is z'-recurrent a.s. □ 

Lemma 3.3. Let z eZ,z > then P{RECY{z) n RECX{z)) = 0. 

Proof. If is z-recurrent, it wih eat all the cookies between z and z + 1 a.s. 

Thus {Yn} can't return to z i.o a.s. □ 

Corollary 3.4. For every zeZ, F{TRSY\RECX{z)) = 1 

Proof. 

P{TRSY n RECX{z)) 

= P TRSY n RECX{z) n (y,,RECY{z') \;^{yj,,RECY{z')) 

= P[RECX{z) n U,>RECY{z')] + P[RECX{z) n {U,>RECY{z')) 
= P[RECX{z)] 



(3.2) 



where (+J stands for disjoint union and the second equality follows from the fact 
that by Lemma 13.31 

P[RECX{z) n VJ,iRECY{z) n TRSY] < 

P[RECX{z) n U^>RECY{z')] =0. ^ ' ^ 

□ 

Corollary 3.5. P{TRSY\TRSX'') = 1. 

Proof. Given TRSX'^ there exists some z such that RECX{z) occurs. In that case 
we saw TRSY occurs a.s. □ 

Lemma 3.6. Let z£Z, P {RECY {z)\T RS X) = 0. 

Proof. Let r = sup{m > 0|Xm = for some ^ > z. For infinitely many times, 
greater than r, {Y^} will reach z and {X^} will be to the right of ^. If {X„} is to 
the right of maxjz' € Z : 3A; < n, 1^ = z'}, there are no eaten cookies in its position 
and {Xn] has probability ^ to go left. If {-'^n} is to the left of max{z € Z : 3A; < 
n, Yfc = z}, there are no cookies left between z and max{z E Z : 3A; < n,Yfc = z}. 
In this case {^n} will go right until it reaches an uneaten cookie, and again it has 
a probability ^ of going left. Thus by the Borel-Cantelli lemma {Xn} will eat all 
the cookies in a site ^' > z, after {Yn} passes ^' it will never return to z which 
contradicts the z-recurrence of {^«}. □ 

Corollary 3.7. PiTRSY'^lTRSX) = 0. 

Proof PiTRSY^lTRSX) < Y.^P{RECY{z)\TRSX) =0. □ 
Corollary 3.8. P{TRSY\TRSX) = 1. 

Proof. 1 = P{TRSY\TRSX) + P{TRSY''\TRSX) = P{TRSY\TRSX). □ 
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Proof of proposition \3.1l 

P{TRSY) = P(TRSY\TRSX)P{TRSX) +P(TRSY\TRSX'')P{TRSX'') 
= P{TRSX U TRSX'') = 1. 

(3.4) 
□ 

Proposition 3.9. The MERW is transient for all ^ < p < I. 

Proof. Without loss of generality we prove Xn is transient. By Lemma 12.51 the 
intersection environment dominates an i.i.d RWRE ^. For some realization of ^ 
let a'^_j^ be i.i.d, with distribution T-k, and a\ be i.i.d with distribution ti, such 
that C7^^ and al are coupled by the same random walk on ^. Denote by B[k,m] = 
n^J^i < aLJ. By Corollary [231 



P{B[k,m])>{l-2{E[po]fr. (3.5) 
We obtain by first order approximations that 

P{B[n,n''r) <!-(!- 2(E[po])")"' < 2n'B[por, (3.6) 

thus 

P{B[n,n'^Y lo) = 0. (3.7) 

Since L„ stochastically dominates the maximum of SRW, it is asymptotically 
larger than n*. Denote by Gn the event 



and let M„ be the maximum of a SRW and the first hitting time of a SRW in 
the vertex a. Thus 

P (G^) < P (a/„ < ni) = P (v/4 >n)<^, (3.8) 

where the last inequality is Markov's inequality. Thus 

P (GU i.o) = 0. 



PiTRSV) < P (Xn backtracks from L„ to i.o) . (3.9) 
Since between times to time (n+1)^ there can be at most backtrack attempts, 

P {Xn backtracks from L„ i.o) = P {Xn backtracks from Ln i.o| {G^4 i-o}'^) 

< P(S[n,nY i-o) = 0. 

(3.10) 
□ 
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3.2 Tightness bounds 

Definition 3.3. We say that a sequence of random variables {Zn}^^i is tight, if 
for every e > there exists some M > such that for all n 

P(|Z„| > M) < e. 

In this section we begin the work to show that the process {X„ — l^j^^ is 
tight, and give bounds that will be useful in later sections. 

We start with a simple lemma stating that both walks and both fronts are 
relatively close to each other. 

Lemma 3.10. For all n large enough, 

1. P(Mx(n) - X{n) > n°-6) < e~"" ' 

2. P(|y(n) - X{n)\ > nO-6) < g-""'' 

Proof. We first show that if n is sufficiently large then 

P(L(n) - X(n) > < e-"" '. (3.11) 

Equivalently, 

P(L(n) - Y{n) > n"-^) < e""" '. (3.12) 

()3.1ip follows from Lemma 12.21 and Lemma 12.51 Indeed, L{n) — X(n) > nP'^ 
only if there exists a backtrack excursion up to time n of length larger than y/n. 
Since there are at most n such excursions, and we know that for each of those the 
probability of being larger than ^/n is exponentially small in ^/n, we get that for 
some constant C, 

P(L(n) - Xin) > n°-5) < ne^^^ < e""" ' 

for n large enough. 

To finish the proof of the lemma, we need to show that 

P{R{n) - L{n) > n^-^) < e"""' . (3.13) 

To this end, we show that R{n) — L{n) is dominated by the front of a simple 
random walk, and then ()3.13p will follow immediately by Azuma's inequality and 
the reflection principle. 

To see the domination, all we need to note is that R{n)—L[n) < max{max(X/fc, 1^) — 
L{k)~^ : k = 1, . . . , n} and that the evolution of max(X„, Yn) — L{n) is dominated 
by that of a simple random walk. 

□ 

We define the event An that the gaps did not grow faster than desired: For 
every n i.e. 

An = {yi<k<nMx{k) - X{k) < nO-*5 and \Y{k) - X{k)\ < n^-''}. 
Then the probability of decays stretched exponentially with n. 

Definition 3.4. We say thatt is a fresh epoch if R{t) = X{t) = Y{t) = R{t-1) + 1. 
We denote by F{t) the event that t is a fresh epoch. 
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The next lemma governs the probabiHty of appearance of fresh epochs. 



Lemma 3.11. There exists a constant C such that 



P U F{t) 



t=n 



X{l),...,X{n-l),Yil),...,Y{n-l),A2n I > l-exp(-C7nO-i) a.s 



Proof. The lemma will follow immediately once we prove that there exists a con- 
stant C such that, under the same conditioning, the probability that there exists a 
fresh epoch between n and n + Cn^'^ is bounded away from zero. 

To this end we define the following sequence of stopping times: 

We define Mq := R{n) 

Let Z G {X, y} be the walk that corresponds to R{n), and let W be the other 
walk. Then Tq := min{t : W{t) = Mq}. 
Now define Mi := R{To). 

We continue to recursively define Mk and for all values of k. 

We now need to make estimates on the random variables and T^. 

Define the event Uk- 

Uk := {Tfc+i - Tfc < and R{Tk+i) - R{Tk) < {Tk+i - Tkf^}. 

We next estimate the probability of the event Uk- 
Claim 3.12. 

P(C/fc^|C/i,...,C/fc_i)<e-°-"-''' 

We now assume Claim 13.121 (We will prove it later) and finish the proof of 
Lemma 13.111 

Let M be large but fixed, and let /cq = ^o(^) be the smallest number so that 



n 



0.65*0 



< M. Then by Claim [XT2l P([/i n C/2 n . . . n C/fcJ is bounded away from 
zero. Conditioned on the event Ui D U2 D ■ ■ ■ Ci Ukg, the probability a fresh epoch 
existence within the time frame [n,n + Cn'^'^] is at least 0.25*^ (probability for both 
the walks to move M positions to the right is bigger than 0.25^). 

□ 

Proof of Claim lSJR Let Z G {X,Y} be so that R{Tk) = Mz{Tk), and let W be 
the other element of {X, y}. 

Conditioned on the occurrence of Uk-i, the distance between R{Tk) and W{Tk) 
is bounded by Cn^'^ , and therefore, by Lemma [2. 5 1 and Theorem l2.4l the probability 
that Tfc+i — Tfc > ttP-^^ decays stretched-exponentially with nP'^ . To control the 
probability that R{Tk+i) — R{Tk) > {T^+i — T^)^'^ we note that between times 
and T^+i the right front is dominated by the front of a refiected SRW. □ 

3.3 Regeneration times 

Definition 3.5. We say that t is a regeneration time if 
1- Xt = Yt. 

2. For every s > t, Xg > Xt and Yg >Yt. 

3. For every s <t, Xg < Xt and Yg <Yt. 
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P(y(0)) > aP(Vn > 3M no backtracking from L„ to 0) 

oo 
n=3m 

where the last inequahty holds for M large enough by 



Note that every regeneration time is a fresh epoch, but not vice versa. On the 
other hand, we have the following two facts, which show that many fresh epochs 
are indeed regeneration times. 

Lemma 3.13. Let F{t) be the event that t is a fresh epoch, and let V{t) be the 
event that t is a regeneration time. There exists a fixed p = pip), which is strictly 
between zero and one, such that for every t, 

F{Vit)\F{t))=p. 

Proof. Denote hy p = F{V{0)). Notice that the event that a fresh epoch is a 
regeneration time is dependent only on the trajectory of the MERW to the right 
of the MERW at the fresh epoch. Thus for every t, P{V{t)\F{t)) = P{V{0)). By 
Proposition l3.9l the MERW is transient and thus visits the origin finitely many times 
a.s. Clearly, p < 1 since there is a probability greater than 1 — for at least one 
of the walkers to turn left and thus admit V{OY. We are left with proving p > 0. 
Let M E N, then with positive probability, a > 0, after 3M steps, the intersection 
environment of the MERW in [0, M] is constant p. By the same argument as in the 
proof of Proposition 13.91 



(3.14) 



□ 

Lemma 3.14. For every n, let tn be the first fresh epoch after time n. For every 
k < let h{k) = n + kn^-^. Let 

Bn = {3at least n^'^ fresh epochs between time h{k) and h{k + 1)} 

Q{k) = V{thik)) 
Then for every n big enough 

P (Qik) Inj^kQUr, Bn, A2n ) > p/2. 

Proof Let H{k) = \^3t G [thik-i) + hKk)] ,mm{Xt,Yt} = thus 

P (Qik) |nj<fcQOr , Bn, A2n)=P (Qik) n H{k) |n,<fcQ(jr , A2n ) 

+ p (Qik) n H{kY In.^kQUY, ^n, ^2n ) 

> P (Qik) iDj^kQUr, Bn,A2n,H{k) ) I'{H{k)\ n,<,. QUr, Bn, A2n). 

(3.16) 

Given Bn the probability of H{kY is stretch exponentially small, i.e. 

P{H{kf\ nj^,Q{jr,Br.) < e— °\ (3.17) 

Under H{k) the probability of a regeneration at is independent of ^j<kQ{jY ■ 
By lemma [3.131 and (j3.17p . for n large enough 

P {Q{k) \r\j<kQ{jr, Bn, A2n, H{k) ) V{H{k)\ n,<fc Q{jf, Bn, A2n) > p/2. 

□ 
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Theorem 3.15. There exists a constant ^ > such that for all large enough n, 



\k=l 



Proof. 



,k=l 



2n 



= llF[Q{jrBr„A2n,f]Q{kr 

j=l \ k=l 

<(i-p/2r". 



(3.18) 



Thus 



^=1 



Bn,A2n +P((S„nA 



2n) 



and the RHS of p.l9p decays stretch exponentially. 

Corollary 3.16. Let t be a regeneration time then E[Xt-] < oo. 
Proof. I Xr I < r thus by theorem 13.151 

E[Xr] < E[r] < oo. 



(3.19) 



□ 



□ 



Lemma 3.17. Let ti < T2 < . . . be all the regeneration times, then {rj+i — TjjigN 
are i.i.d. 

Proof. Let r < cr be a two regeneration times. {Xr+t}, {Yt+t} are independent of 
all the trajectories to the left of {^r}i thus o" — r is independent of r. Since after 
every regeneration time the process runs on the same environment the regeneration 
differences {rj+i — TjjjgN are identically distributed. □ 

Using Theorem 13.151 Lemma 13.171 and the law of large numbers we have 

Xr^ i LLN E[Xt-2 — Xt-^] 



def ,. Xt 

V = lim = hm . — 

j— >oo Tj i— >oo i Ti E[T2 — T\\ 



(3.20) 



For every n there exists some i{n) such that Tj(„) < n < Ti(^n)+i and satisfy X^-.^^^^ < 
Xn < Xr-, . thus 



This yields the main theorem of this section 



n ri— >oo 



(3.21) 



11 



Theorem 3.18. For every ^ < p < 1, {Xn} and {Yn} have positive speed a.s. i.e 

lim — - = lim — = v > 0, a.s. 

n— >oo n n— >oo n 

Proposition 3.19. For i < p < 1 The speed v is smaller than - — ^ — . 

Proof. Let Vi be the number of drifts {^n} left in the interval -'^Ti+i ~^Ti after time 
Tj+i and uj G {0, 1}^ be 1 in the positions where {Xn} left a drift and elsewhere. 
By the discussion above Ui are i.i.d. Let A = hmj_>oo Note that Yn has a smaller 
drift at any position than the drift left by Xn after the next regeneration time. 
Thus the speed of Yn which equals the speed of Xn is smaller than the speed of 
a RWRE on the environment uj. By |PR12j Theorem 1.3, v < {2p — 1)A. But 
each drift left requires at least two moves, thus v < 1 — 2A. Combining the two 
inequalities we get the proposition. 

□ 



4 Markov approximation 

In this section we present a family of Markov processes whose speed approximates 
the speed of MERW, and has a simple yet hard to calculate representation. 

4.1 The model for the /c'th process 

Consider two MERW with transition probabilities as in p.3|) truncated at Rn — k, 
i.e if Xn or Yn reach a distance k (even) from the right front, they turn right 
with probability one. The state space of this Markov process Z,^ is contained in 
{0, 1, 2}"^^ X {0, k}"^. In each of the k positions, one has to know the number of 
times Xn and Yn visited and one has to know the current position of the two walks. 
Given that knowledge, the next state is calculated by ()1.3p and the constraint. 
The environment changes according to the movement of the walks. As an example 
consider the case k = 2, denote by a square one process and by a circle the other. 



(0,1) (0,1) 




(2,2) (2,2) (2,2) (0,1) 



Next we prove convergence of the Markov chain speed to the MERW speed. 
By (|3.20p . it is enough to control the change of regeneration time and distance 
expectation. 

Lemma 4.1. Let Ak = {3ri < n < T2 : Xn < Rn — k}, then P(^fc) — > 0. 

k—^oo 

Proof. Let = {t2 — ti > k}, from Theorem 13.151 P(i?fc) — > 0, moreover for 

P £ bi'^'z] for some 1/2 < pi < p2 < 1 the convergence is uniform. If X„ < Rn — k 
it will take more than k steps for X„ to reach a fresh point. Thus C and 
P{Ak) 0. □ 

fc— ^oo 
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Lemma 4.2. Let Vk be the speed of the k'th Markov process. For all 1/2 < pi < 
P<Ph<'^, liiufc^oo Vk{p) = v{p) uniformly. 

Proof. We calculate the speed change caused by truncation, by conditioning on the 
event Ai^. 

E[(r2 - Ti)Uj < ^n{r2-n?]Ml\^\ 

, ^ (4.1) 

= 7P(i;)VE[(r2-ri)2] 0. 

fc— >oo 

Where the inequality is by Cauchy-Schwarz and the limit is due to Lemma [4. 11 Let 
Zn be one of the truncated MERW, an its regeneration times and Xn be one of the 
MERW, 

E[f72-ai] 

_ E[(Z^, - Z.JIaJ + E[(Z^, - Z.J1a|] 

E[(CT2 - + E[(fT2 - C7i)lAl] 

_ E[{Z^,-Z^,)lA,]+niXr,-Xr,)lAl] ^ ■ ^ 

E[(cj2 - ^i)1aJ + E[(r2 - ri)l^c] 
E[r2 - n] - E[(r2 - t^IaJ + E[(a2 - cti)1aJ 

Let 

Ek = max{2E[(r2 - t^IaJ, 2E[(ct2 - cti)1^J} (4.3) 
By (fOj) hmfc_,oo Efe = 0. Combining (02]) and (03]) yields, 



Vk < 



B[T2-n]-ek E[r2-ri] I - E\^t^ E[r2 - n] - 



Vk > 



E[r2 - Ti] + Ek E[r2 - n] + Ek E[r2 - n] + 

^["^r2 ~ ^T-i] 1 £fc ^ ^ 

E[r2 - Ti] 1 + E[^2-nj - n] + e/c fc^oo ^' 



^ E[^r2 -^n] A ^ 2gfc \ ^ gfc (4.4) 

E[r2 - Ti] V E[r2 - n] J E[r2 - n] - Ek 

= V + 2EkB[Xr, - Xr,] + V. 

For the lower bound 

E[^T2 — ^T-i] — ^k _ E[Xt-2 — Xt-J Ek 



(4.5) 



□ 



4.2 What do we get from the Markov approximation? 

In this section we show some results one can obtain using the Markov approximation 
tool. 

Lemma 4.3. The speed vi^{p) is continuous on the interval l] ■ 
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Proof. Let be the number of steps turned to the right minus the number of 
left turns. We can write the speed as Vk = Yly '^{y)'^{y)-> where 7r(-) is the stationary- 
distribution and (T{y) is the drift has in state y. To see this 



= lim = Hm = hm - y E Ld^ , ^ - 



j=0 

^ n— 1 

hm -^a(X^-) = j;vr(yMy). 



(4.6) 



n 

i=0 



Both o"(?/) and 7r(?/) are continuous function of p, since the sum is over a finite space 
state, Vk is a continues function of p. □ 

Theorem 4.4. T/ie speed v{p) is continuous on the interval l). 

Proof. The continuity in the interval (^,1) is an easy conclusion from the uniform 
convergence of Vk to v derived in Lemma 14.21 and the continuity of Vk is proved 
in lemma IT3l For every p we have an upper bound for the speed, v{p) < 2p — 1. 
Taking the limit p — )■ ^ we obtain continuity at ^, 



0<v{-] < hm 2p - 1 = 0. 



2/ -p^i 



□ 



4.3 Deterministic approximation of the speed 

Let Pk{x,y) be the transition matrix of Zl^. It is easy to see that 



lim max 

m— >oo X 



^P]:{x,y)a{y)-Vk 



This provides us with a deterministic algorithm to calculate Vk. Given this calcu- 
lation, by Lemma 14.21 we can find pi < p2 and k large enough such that Vk{pi) > 
Vk{P2) and \v{p) — Vk{p)\ < for all p G [pi,P2] and thus attain the 

non-monotonicity of v{p). We were not able to make the proposed calculations as 
its complexity is too high for today's computers. 



5 Open questions 

1. The base of our technique was to use RWRE, this only works for p < 1. One 
important question that eludes us is: Is v{p) continuous at p = 1. 

2. Consider a generalization of the MERW model, MERW(m). m is the initial 
number of symmetric cookies in each site. That is 

m times 

u;i{z)\ ^ f(i/2^^^~T/2,p,p,p,...) 
uj2{z)J \il/2,...,l/2,p,p,p,...) 

m times 
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An interesting conjecture arise from simulations (See Figure [5?T]l . For m large 
enough Vm{p) is monotone, where Vmip) is the speed of MERW(m). 
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Figure 5.1: Speed of MERW(m), m = 3, 5 



7 



15 



